Search for: All records

We study a model-free federated linear quadratic regulator (LQR) problem where M agents with unknown, distinct yet similar dynamics collaboratively learn an optimal policy to minimize an average quadratic cost while keeping their data private. To exploit the similarity of the agents' dynamics, we propose to use federated learning (FL) to allow the agents to periodically communicate with a central server to train policies by leveraging a larger dataset from all the agents. With this setup, we seek to understand the following questions: (i) Is the learned common policy stabilizing for all agents? (ii) How close is the learned common policy to each agent's own optimal policy? (iii) Can each agent learn its own optimal policy faster by leveraging data from all agents? To answer these questions, we propose a federated and model-free algorithm named FedLQR. Our analysis overcomes numerous technical challenges, such as heterogeneity in the agents' dynamics, multiple local updates, and stability concerns. We show that FedLQR produces a common policy that, at each iteration, is stabilizing for all agents. We provide bounds on the distance between the common policy and each agent's local optimal policy. Furthermore, we prove that when learning each agent's optimal policy, FedLQR achieves a sample complexity reduction proportional to the number of agents M in a low-heterogeneity regime, compared to the single-agent setting. 

We initiate the study of federated reinforcement learning under environmental heterogeneity by considering a policy evaluation problem. Our setup involves agents interacting with environments that share the same state and action space but differ in their reward functions and state transition kernels. Assuming agents can communicate via a central server, we ask: Does exchanging information expedite the process of evaluating a common policy? To answer this question, we provide the first comprehensive finite-time analysis of a federated temporal difference (TD) learning algorithm with linear function approximation, while accounting for Markovian sampling, heterogeneity in the agents' environments, and multiple local updates to save communication. Our analysis crucially relies on several novel ingredients: (i) deriving perturbation bounds on TD fixed points as a function of the heterogeneity in the agents' underlying Markov decision processes (MDPs); (ii) introducing a virtual MDP to closely approximate the dynamics of the federated TD algorithm; and (iii) using the virtual MDP to make explicit connections to federated optimization. Putting these pieces together, we rigorously prove that in a low-heterogeneity regime, exchanging model estimates leads to linear convergence speedups in the number of agents. 

We revisit the implementation of a two-qubit entangling gate, the Mølmer-Sørensen gate, using the adiabatic Rydberg dressing paradigm. We study the implementation of rapid adiabatic passage using a two-photon transition, which does not require the use of an ultra-violet laser, and can be implemented using only amplitude modulation of one field with all laser frequencies fixed. We find that entangling gate fidelities, comparable to the one-photon excitation, are achievable with the two-photon excitation. Moreover, we address how the adiabatic dressing protocol can be used to implement entangling gates outside the regime of a perfect Rydberg blockade. We show that using adiabatic dressing we can achieve a scaling of gate fidelity set by the fundamental limits to entanglement generated by the Rydberg interactions while simultaneously retaining limited population in the doubly excited Rydberg state. This allows for fast high fidelity gates for atoms separated beyond the blockade radius. 

This presentation reports different methods of making gallium-based liquid metal (LM) microfluidics passive frequency selective surfaces (FSS). In the first method Si wafer was dry-etched to form a mold and PDMS was replicated from the Si mold to create microfluidic channels with 5x5 array of 300μm width and 200 μm height for Jerusalem cross bars structure, surrounded by four fixed 2 x 1 x 0.2 mm structures. A PDMS lid having 1 mm diameter holes obtained from SLA 3D printed pillar array was aligned and bonded to the replicated PDMS to create sealed microfluidic channels. The bonded structure was placed with lid upwards in an open top 3D printed container measuring 64mm x 64mmarea and 25 mm height. LM was flooded into the container and loaded in Temescal e-beam evaporator at atmospheric pressure. Pressure in evaporator was dropped to 5.75 x 10-6Torr. After a vacuum period of 2 hours LM filling takes place in microfluidic structures because of positive pressure differential introduced by atmospheric pressure. In second method 70 μmthick SU8-2075 stencil consisting of a patterned 1x1 array of see-through FSS structure of above-mentioned dimensions was released from oxidized Si wafer using7:1 BOE. The SU8-2075 stencil was placed over a partially cured PDMS. After complete PDMS curing, an airbrush filled with LM operating at 36 psi with spraying time of less than 5 seconds, placed 4-5 cm over the stencil yields the patterned 1x1 FSS structure after removal of SU8-2075. 

The direct search for dark matter in the form of weakly interacting massive particles (WIMP) is performed by detecting nuclear recoils produced in a target material from the WIMP elastic scattering. The experimental identification of the direction of the WIMP-induced nuclear recoils is a crucial asset in this field, as it enables unmistakable modulation signatures for dark matter. The Recoil Directionality (ReD) experiment was designed to probe for such directional sensitivity in argon dual-phase time projection chambers (TPC), that are widely considered for current and future direct dark matter searches. The TPC of ReD was irradiated with neutrons at the INFN Laboratori Nazionali del Sud. Data were taken with nuclear recoils of known directions and kinetic energy of 72 keV, which is within the range of interest for WIMP-induced signals in argon. The direction-dependent liquid argon charge recombination model by Cataudella et al. was adopted and a likelihood statistical analysis was performed, which gave no indications of significant dependence of the detector response to the recoil direction. The aspect ratioRof the initial ionization cloud is$$R < 1.072$$$R<1.072$with 90 % confidence level.

 

Abstract The Aria cryogenic distillation plant, located in Sardinia, Italy, is a key component of the DarkSide-20k experimental program for WIMP dark matter searches at the INFN Laboratori Nazionali del Gran Sasso, Italy. Aria is designed to purify the argon, extracted from underground wells in Colorado, USA, and used as the DarkSide-20k target material, to detector-grade quality. In this paper, we report the first measurement of argon isotopic separation by distillation with the 26 m tall Aria prototype. We discuss the measurement of the operating parameters of the column and the observation of the simultaneous separation of the three stable argon isotopes: $${}^{36}\hbox {Ar}$$ 36 Ar , $${}^{38}\textrm{Ar}$$ 38 Ar , and $${}^{40}\textrm{Ar}$$ 40 Ar . We also provide a detailed comparison of the experimental results with commercial process simulation software. This measurement of isotopic separation of argon is a significant achievement for the project, building on the success of the initial demonstration of isotopic separation of nitrogen using the same equipment in 2019. 

A search for pair production of squarks or gluinos decaying via sleptons or weak bosons is reported. The search targets a final state with exactly two leptons with same-sign electric charge or at least three leptons without any charge requirement. The analysed data set corresponds to an integrated luminosity of 139 fb⁻¹of proton-proton collisions collected at a centre-of-mass energy of 13 TeV with the ATLAS detector at the LHC. Multiple signal regions are defined, targeting several SUSY simplified models yielding the desired final states. A single control region is used to constrain the normalisation of theWZ+ jets background. No significant excess of events over the Standard Model expectation is observed. The results are interpreted in the context of several supersymmetric models featuring R-parity conservation or R-parity violation, yielding exclusion limits surpassing those from previous searches. In models considering gluino (squark) pair production, gluino (squark) masses up to 2.2 (1.7) TeV are excluded at 95% confidence level.